Unsupervised Dynamic Texture Segmentation Using Appearance and Motion
نویسندگان
چکیده
Dynamic texture (DT) is an extension of texture to the temporal domain. How to segment DTs is a challenging problem. In this paper, we address the problem of segmenting DT into disjoint volumes in an unsupervised way. DTs might be different from their spatial mode (i.e., appearance) and/or temporal mode (i.e., motion field). To this end, we develop a framework based on the appearance and motion modes. For the appearance mode, we use a new local spatial texture descriptor to describe the spatial mode of DT; for the motion mode, we use the optical flow and the local temporal texture descriptor to represent the temporal variations of DT. In addition, for the optical flow, we use the Histogram of Oriented Optical Flow (HOOF) to organize them. To compute the distance between two HOOFs, we develop a simple, effective and efficient distance measure based on Weber Law. Each volume is characterized by its appearance and motion modes. Furthermore, we also address the important problem of threshold selection by proposing a method for determining thresholds for the segmentation method by statistical learning. Experimental results show that our method provides very good segmentation results compared to the state-of-the-art methods in segmenting volumes that differ in their dynamics.
منابع مشابه
Unsupervised Texture Image Segmentation Using MRFEM Framework
Texture image analysis is one of the most important working realms of image processing in medical sciences and industry. Up to present, different approaches have been proposed for segmentation of texture images. In this paper, we offered unsupervised texture image segmentation based on Markov Random Field (MRF) model. First, we used Gabor filter with different parameters’ (frequency, orientatio...
متن کاملUnsupervised Texture Image Segmentation Using MRFEM Framework
Texture image analysis is one of the most important working realms of image processing in medical sciences and industry. Up to present, different approaches have been proposed for segmentation of texture images. In this paper, we offered unsupervised texture image segmentation based on Markov Random Field (MRF) model. First, we used Gabor filter with different parameters’ (frequency, orientatio...
متن کاملSegmentation of Dynamic Scenes with Distributions of Spatiotemporally Oriented Energies
In video segmentation, disambiguating appearance cues by grouping similar motions or dynamics is potentially powerful, though non-trivial. Dynamic changes of appearance can occur from rigid or non-rigid motion, as well as complex dynamic textures. While the former are easily captured by optical flow, phenomena such as a dissipating cloud of smoke, or flickering reflections on water, do not sati...
متن کاملBlock Motion Based Dynamic Texture Analysis: A Review
Dynamic texture refers to image sequences of non-rigid objects that exhibit some regularity in their movement. Videos of smoke, fire etc. fall under the category of dynamic texture. Researchers have investigated different ways to analyze dynamic textures since early nineties. Both appearance based (image intensities) and motion based approaches are investigated. Motion based approaches turn out...
متن کاملUnsupervised Dynamic Textures Segmentation
This paper presents an unsupervised dynamic colour texture segmentation method with unknown and variable number of texture classes. Single regions with dynamic textures can furthermore change their location as well as their shape. Individual dynamic multispectral texture mosaic frames are locally represented by Markovian features derived from four directional multispectral Markovian models recu...
متن کامل